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ABSTRACT ' ’ 

A number of different methods have been used by 
instructicnal television (ITV) projects to obtain audience feedback, 
and some of these are now being used in the ITV system in El . 
Salvador. He know that pretesting programs on a representative sample 
can bring considerable gains in learning. Another feedback source can 
be ft classrooh of pupils in the production studio, or a smaT^r^umber 
of students participating in programs on camera. Some projects 
teaching advanced material have used a talk-back system that permits 
s tude nts to use remote miOrophones to talk to studio teachers and to 
have idieir guestions or comments broadcast to the whole audience. A 
device found on almost all projects is classroom testing. Because 
tests are time-consjuming they are often separated by wide intervals. 
However weekly tests can be provided over t^^evision, and the results 
quickly integrated into program content. Finally, regular comments 
from classroon teachers, supervisors and utilization workers are 
common to many projects. And although ITV /in El Salvador uses some of 
these techniques, current feedback channels ' should be strengthened, 
and new ones developed. (MG) ! 
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"FEEDBACK" FOR INSTRUCTIONAL TELEVISION 



A teacher in a classroom is in good position to know, how the 

lesson is going. He can see whether his pupils are paying attention. 

By watching their faces and their movements, he can make a good guess 

/ » 

as to whether they are interested. If he has any doubt as to whether 
they are understanding, he can ask a .few questions. If he wants _to 
.know whether everyone has learned the day's lesson, he can give a 

'9 

brief test. And if the pupils themselves are having any difficulties, 
they can ask \for help or explanation.. Thus the teacher is in position 
r.t all times to know whether learning is going on, and, :./t, what ’ 
to do about it: more explanation, more drill, more examples, a dif- 
ferent approach , slower rate of exposition, or what,, 

A television teacher, on> the other hand, does not have instan" 
access to such information. Even if he has pupils in the studio, and 
can watch them, still he cannot possibly watch all the classrooms^ 
where...his- program is being received. Usually, hel teaches to the 
camera rather than to students. No one can ask him a question during 
the program, nor can he see whether attention is good and interest is 
high in the cljassrooms. He cannot asl^a quick ^question to find out 
whether students are getting his point. He cannot help an individual 
student who is in difficulty. Often he has to wait weeks or months 
for comments from the classroom, or for test results. 

For this reason,, most instructional television projects make 
special efforts to obtain "feedback" from the classrooms that are 



using the televised lessons. Feedback is a word borrowed^ from elec- 

I 

uronici; find..u 5 pd. by corimmicetion-theorists to denote thi information 
that comes back’ to a communicator by which he can judge the effective- 
ness of his message. In an ITV project there is nothing ^theoretical** 
or impractical about a feedback system: It is simply a way to, substi- 

tute for^ the kind of information on pupil response easily available to 

\ 

a classroom teacher. It is immensely important to the studio teacher 
because he is responsible for a great number and variety of pupils, 
and the effect of a mistake or misjudgment in tactic is therefore 
multiplied. • 

The purpose of this memorandum is to describe briefly a 
number of the different methods that have been used by Instructional 
t(‘^.;!vision projects to obtain feedback information. 

Needless to say, no ongoing ITV project has ever claimed to 
have achieved >an.4deal system of feedback. The enormous ’initial 
effevt required to master the technique and technology of ITV usually 
leaves all too little time and money for **software** needs, and amongst 
these the need for feedback usually rates, far below the need for 
programs. Nevertheless, most of the recent major ITV projects in 
(fi.'.veloping countries have built in some kind or kinds of provision 
for feedback. The most common one (as, for example, in Samoa)' is to 
ask classroom teachers each week to till in checklists of comments 
on the television programs. Some projects (for example, .Colombia) 
have provided for a group of utilization specialists to visit clas':- 
rooms at regular intervals, both. to assist the teacher in solving 



the problems of using television and also to report back on classroprr. 
responses to the programs. A very fe\7 projects (for example^ Niger, 
in the early years of the television • experiment there) have provided 
for research personnel to observt and study closely what happens in 
the classroom. 

The architects of the El Salvador educational reform program 
have been aware of these precedents, and have built several feedback 
channels into their plans. The following pages will serve as a check- 
list by which^to compare what "El Salvador is doing in this respect 
against what might be done. Let us hasten to say, however, that no 
ITV project up to this time has ever made use, of all the methods 
listed in this memorandum ,._and' probably no project ever wilier \ 
should. The preferred strategy is to select some combinatibo-o.^ \ 
feedback methods. to serve local needs and fit local capabilities. 

For El Salvador readers of this memorandum; let us suggest two 
puections: Are there^^additional feedback channels that should he 

added to those presently in use? And, what, if anythingi - needs to 
done to make existing feedback channels work more efficiently? 

The methods to be described in. this memorandum are: 

1, Pretesting programs 

2. Teaching to pupils in the studio - 

3. Immediate electronic feedback from the classroom 

4, .Testing at frequent intervals on learning of program 

content 

% ' 

5 / Obtaining regular comments from classroom teachers 



\ 



6. Making regular observations of classroom activity 

7. Obtaining' regular reports on attitudes of pupils and 

teachers 

8. Obtaining reports on specific probl’ems 

9. Expert reviews \of programs and materials 

\ 

Pretesting programs 

N 

Ideally, every ITV program should be tested on a representa- 
tive sample of the intended audience before it is broadcast to the 
entire school system. We knov; that pretesting and revising can bring 
about spectacular improvement; evidence of this is the Lumsdaine and 
Cropper experiment of 1961, in which students learned a great deal 
r.cre from science lessons that had been pretested and revised than 
from the lessons in their original form. When the^lesson was tested 
and . revised twic£, there was still more learning. No tele teacher, 
no matter how expert, can be completely confident that his televised 
programs will accomplish everything they are expected to until they 
have been tried on students: That is the reason for pretesting. 

However, pretesting and revision are expensive and time- 
consuming. They are often resisted by producers who are trying to 
keep a schedule, by teleteachers who are sensitive to criticism, 
by program personnel in general who are awate of the artistic elemc.^ 
in programming and don’t want to see it diluted by a scientifi^Tff L:. 
tude toward the effect o£ teaching. Therefore, the usual compromi:e 
is to test a few pro to type programs — programs that can be made far 
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enough in advance to leave ^.ime for testing, and are sufficiently 
representative so that the results of testing them will throw light 
on the way the entire series should be taught. 

Pretesting is research, and should be planned and' conducted 



‘by persons trained in research. ^^Ssentially it is a simple process , 
hov;ever. The prototype is s^t^ened for a classroom or several class- 
rooms of students. It necessary to know enough about the'^tudents 

• . ■ 

to make sure they^epresent other students, or different groups of 
the students, f whom the programs are being made. It is necessary 
to have a/lspread of abHitieS in the sample, so that the teacher can 




be he is not overreaching, or underreaching. It is necessary to 



ave a clear statement of what the program is expected to teach, so 
that tests can be based on these objectives. Unless the subject 



matter is completely new to^the students, it is customary to give 

matched tests before and after the showing- so as to measure the 

f 

change brought about by the program. The attention and interest 
of the students are observed or measured by whatever method* seems 
best to the researchers. If there is any considerable misunder- 
standing or failure to learn, students who have done poorly are 
often interviewed individually in order to find out where the 
teaching has gone wrong. Then the results and recommendations 
are presented to the program personnel. 

Even a single prototype program from each series, carefall;; 
tested long enough in advance to influence the rest of the series, 
can make a notable difference in the ef fec.tiveness of a televised 
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course* When the ideal project, if any, is designed, a program of 
testing prototype programs will probably be combined with an ongoing 
program of basic research, so that teaching problems revealed by the 
prototypes can be studied in depth, alternative solutions can be 
tried, and the results of the basic studies can be incorporated into 
generalizations on ITV method. But this is ideal; even a few proto- 
type tests are as yet uncommon in ITV projects. 

Pupils ih the studio 

One of the feedback devices most commonly used in instruc- 
tional television Is the presence of pupils in the studio. This has 
the advantage of giving the teacher much of the same information he 
v'ould get if he w^re teaching in the classroom: He can observe the 

responses of his pupils, he can sometimes ask them questions, if he 
requires responses from his televisiion audience he can time those 
responses by his studio class. The disadvantage of this method is 
l:hat some pupils may get shortchanged. For example, if one teacheg 
eo a camera so as, to be looking at his classroom audience, he isn*t 
likely to be teaching directly to his studio audience. If he allows 
his studio audience to interrupt and ask questions, as a classroom 
audience might, he may very well lose seme of his cla^5Sroom audience 
And although the research seems to show,, that a studio^class learns 
as much from the teleteacher as does the classroom group (see 
VJolgamuth, 1961), still it is clear that moving a class into the 
kind of studio typically used for taping ITV broadcasts , full of 






cameras, lights, and cables, w^i\ld disrupt not only the school hours \ 

\ 

\ • 

adjacent to the .television> but also the classroom teacher's contri- 
bution to the course. 

Recentlyj a variant of the studio class has come into wide 
use. This is the selection of a small number of students -- generally 
from one to six — to participate in the program, on camera. (Studio 
classes are usually off-caniera. ) The teleteacher uses the§e students 
to help him conduct experiments or demonstrations, to respond where 
class response is expected, sometimes to ask questions or answer 
questions. Thus he is able to time his presentation, and to address 
his remarks to persons rather than to an impersonal camera; and the 
students themselves provide a focus of interest for the classroom 
viewers. So far. as we know, no research has been done directly on 

cnis- practice , but in general the reports ot\ it arc favorable. 

■ i ' 



In^^.ed late feedback from the classfoom ^ 

The more advanced a class" and the more complex the subject, 
tj\e more frustrated a classroom pupil becomes* at not being able to 
hsk questions or otherwise s{^^ak up during a television presentation. 

1 this reason, a number of two-way communication systems have bean 
' tried in experimental ITV projects. At Pennsylvania State Univers*'. ty , 
for example, several versions of a classroom "talkback" "system were 

tried (see Greenhill, 1964). These permitted any student to signal 

\ 

that he wanted to ask a question or make a comment, and at an appro- 
priate time the teletcacher could give him permission to speak into 
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Q 



\ 

a classroom m4.crophone and, in effect, go on the air* These systems 

. ' \ >1 

seemed to*'be e^^ective in reducing the frustration of articulate 
college studen ts\being taught by television, and- also furnished a. 
certain amount of feedback to the teleteacher . In a large educa- 
tional system^ like that of El Salvador, however, they would prove 
infeasible both because of the cost of the feedback link and, because . 
any considerable number of questions and comments from so^inanjT'^lass- 
rooms V70uld disrupt and disorganize the relatj-ydy" brief and condenso 
television presentation. 

A fev7 projects have^itfstalled a television monitor in the 

' C'*' 

studio presdntinc^£K^c ture of one of the classes to whom the tele^ 

vision program is being shown (for example, see Bretz,- 1967). In 

some cases, a loud-sp^ker, tuned low, also has been used so that 

tlie teleteacher can time class responsesT^ This requires a low-cost 

camera in the classroom, and a closed-circuit' or other carrier from 
■ ' /. 

'iLassroom to studio. The advantage is' clear; the disadvantage is 
that the sample classroom may nof represent others. 



Rewlar testing oh program content 

Any ITV project gets, some feedback from classroom tasting. 
Usually this comes so late (at the end of the year or' of a term) 
that the teleteacher and the production staff can no longer correct 
any problems that are revealed. However, there is no reason why 
v;eekly test should not be given, preferably using fiveTninutes of 
the television itself, so that questions can be presented in the 



o 



same way and at the same time to all classes. It would be possible 

to make, the tests brief and correctable by the students or vary 

quickly by the teacher (multiple-choice or short-answer tests) so 
i \ . 

that results of the tests could, be known, if necessary through 

television reports, v;ithin a few hours. This:would allow time to 

reviev; subject matter, if necessary, or to in|troducc different 

r I 

approaches to the topic. ^ , 

‘ ■ ■> i 

Such tests, of course , would- require jfhe program people to ^ 

I . ■ ' 

decide clearly and sharply what they expect'the students^ to learn 

j 

from a given week of television, and what ansWer^'will test whether 
the desired learning has occurred. The experience of school systems 
has been, . however , that it is more difficult to get learning obj'ec- 



tiv^.s stated in behavioral terms, than to frame questions to tqst 
i:he desired beViavior. 

\ 

If a quick-feedback system like this We is going to work 
.*f f nctively , it will be ..necessary to create an \atmpsphere in which 

» ■ i 

•:he classroom teacher does not think he is being tested, but rather 

• ' ^ \ ■ - \ 

is furnishing information to help the teleteacher do a better job. 

Similarly, if the tests are to be graded by the students it will be. 
necessary to separate them from grades in the courses., so that the 
students will not be tempted to copy answers or to report falsely 
high grades. 



R egular comments from classroom teachers 

This is the feedback device most commonly used in ITV projects 
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Once a week or once a month -- iiPi“few projects, after every 'tele- 
Vised class -- Khe teacher is asked to fill out a report blank for 
the studio teacher and other program persohnel.* In order to save 



the classroom teacher* s time, the report isrdesignod^/so that most 
responseis can be made by checking a statement rather than by writing 
a corrjnent. ~ " 1 \ 







An example of this kind of report- forfn is the J 

/ ' 

American Samoa; . ' 


ne used in ^ 

/ 

/ 

y 


- 




Classroom feedback form (Government .of American Samoa^, 
Department of Sducatibn) ^ 


4 


\ 




■ ' < CLASSROOM T 

[Make. a separate sheet 


JACHER FEEDBACK 
for each sub- 



% your principal.] 

You, the classroom teacher, are an important part of the television 
teaching team. You are the one who works directly w'.tn the children. 
Wf' are working togethei to teach them better. ' Will yoL| help us do cur 
part more effectively by completing this feedback? ' 



‘Classroom teacher: 
Date: 

Subject: 

S tUQ io^'Teacher : 



level : \ 
School : 
jbnit number: 
Lesson number: 



Yes 



No 



Be fore the telecast ‘ 

1. I was able to get materials listed. 

2. Tlie directions were clear to me. 

3. I had enough Information to plan well. 

The telecast 

1. The main idea was clear 

2. Tlie pup.ils understood the main idea.. 

3. The pupils were interested. 



[ 1 
[ .] 
[ 1 



[ ] 
[ ] 
[ 1 



[ •] 
[ 1 
[ 1 



[. ] 
[ ] 
[ 1 



<er|c 
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Thci telecast (continued) 

•/ 

4. The pupils could see clearly the things bn the 
screen. 

5. The pupils could hear what was said. 

6. Tlie pupiLs understood what was said. | 

7. The pupils had time to say or to do what the 
studio teacher asked. 

8. The pupils had time to read what was written 
by thj studio teacher. 

Af terlthe telecast ' ‘ 

1. There were enough activities listed— to^keep 

all of the children busy. . . , 

2. The pupijls were very interested. 

3^ The pupils wanted to study more after the 
telecast . 

4. I could use the follow-up materials. 

5. I had time to do the activities. 

/ • ' ' ' • ' 

Ccru iients • ^ - 



Yes 


No 


[ ] 


[ ] 


t 1 


■ [ ] 


[ ] 


■ -['] 


t ] 


[ ] 


t ]■ 


[ ] 



[ 


]- 


[ 


] 


[ 


] 


[ 


] 


t 


] 


[ 


] 


[• 


] 


[ 


] 


t 


] 


[ 


] 



[If lesson was not suitable, please say why. Suggest other activitie 
t.*:at you have used^ ^or this lesson or that you think would be helpfu 
Use back of page if necessary.] 







Note that this form tries to obtain feedback, not only oh the 
televised class, but also on the materials furnished thi^, classroom 
teacher for his part of the class hour. Note also - that the most 
commonly expected problems^ are— represented in ap inventory which can 

in 



be ansv;ered by checking, and thatj 



\ 



addition to this, the teacher 



has'an opportunity to state at greater length--an3r^§ugge.<5^ions he lias, 

. N /I 

or problems he. has encountered. with the lesson. 



The problems encountered with^a form like this are in (a) 



jetting prompt and regular responses from classroom teachers, (b) 



getting information in sufficient detail to know what changes to 









.12 . 

make as a result of it, and (c) relating the often rather generali?.cd 
remarks on the form to specific programs or parts of programs. The 
best solutions to the first problem have usually been to have visiting 
supervisors or school principals collect the forms. No completely 
satisfactory solution has been found to the second problem. Teachers 
are much less willing to set down a . thoughtful comment or suggestion 
than to check a set of statements. When they write a comment it is 
most often something pleasing (“Class going fine," ^*Like the way you 
are teaching,"), rather than suggestions for improvement. Yet the 
most useful information usually comes from specific comments and 
r:ugp,estions. If there is a rash of comments that "the tcievision 
teacher went too fast," or that "materials were not available," then 
thi, central office knows what to do. But if a number of the blanks 
report, for example, that "the pupils., did not understand the main 
idea,*! then more investigation is called for. Someone will have to 
talk to teachers and students, in oi'ider to find out why the lack of \ 
understanding occurred. On the other hand, if teachers could have 
reported, for example, that pupils' did not understand the Pythagorean 
theorem because they did not clearly understand the idea of squaring, 
then the teacher would hav^known that some review was called for. A 
combination of this technique with short quizzes to pinpoint student 
problems suggests itself here.’ Business and industry often encourage 
their employees to submit thoughtful suggestions by offering rewards 
for the must useful ones. Some version of this might be tried in 
school systems. 
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The third problem -- relating comments to a particular program 

♦ . ^ • 

or program* segment -- become s~ more difficult the more programs arc 

covered in a single report. Yet most schools try to protect their 



teachers from having to fill out a feedback report oftener than once 

a week for any course. One solution for this would be to divide the 

\ 

work -- in a course with three television classes a week, for example, 
ask one third of the teacher corps to fill out reports on each day. 

U 

Regular observation of classrooms 

Television instruction is a kind of team teaching, in which 
some of the responsibility is carried by the studio teacher, some by 
the classroom teacher, and some by the teacher whrr^prepares the 
materials and outlines for class use. Yet, unlike what happens in 
:;.ost team teaching, these three teachers do not meet regularly to 

r t 

plan lihat each should do in relation to what the other is doing, 
lyatlver, they count on the makers of the curriculum outline and 
teachers guide to ensure that the classroom teacher will fit his 
part of the teaching to what comes in on the television. Whether - 
this actually happens is in doubt as long as the team teachers are 

I 

isolated from each other. 

When supervisors or utilization officers observe classrooms, 
they are able to bring back not only a report on what the classroom 

t 

teachers think of the. television teaching, but also a description of 
'.’hat happened during theit time in the classroom: how the students 

reacted, how the' class went, and, perhaps most important, how the 



O 
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classroom teacher is conducing his part of the class period. For 
comments on how a classroom observation can be conducted,' see Research 
Memorandum No. 1 -- "Measuring Educational Development Through Class- 
room Interaction," September, 1969. 

V 

A simpler, less systematic, but highly effective form of 
classroom observation can be accomplished by the television teachers 
themselves. If the televised classes are transmitted from videotape, 
as most of them are today, every studio teacher can visit a class -- 
perhaps once a week -- to watch what happens when his own program is 
broadcast. Some teleteachers worry lest their presence in a classroom 
wouid destroy the* "liveness" of the broadcast; others have been known 
to v7orry lest their appearance in life detract from the personality 
they have built up on television. So tar as the second objection is" 
concerned, the re^lt is usually the opposite: They are receiv ed as 

old friends, and soon find, as television entertainers have long 
known, that "personal appearances" help' rather than hurt their tele- 
vision reputation. So far as the first objection goes, no negative 
effects have been reported, and even if there had been some, they 
would easily have been counterbalanced by what the studio teacher 
learns by seeing his own teaching used in an actual classroom. 

Reports on attitudes 

I . 

Several of the feedback methods we have mentioned provide 
indirect information on whether students like televised teaching, ' 
what they like or dislike about it, whether teachers feel comfortable 
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with it, degraded by it, or threatened by it, and what they find 
helpful or difficult,, desirable or undesirable, about.it. These 
same questions can be answered directly and more systematically by 
administering attitude scales. The tests must be made carefully and 
skillfully so as not to encourage answers that might be thought to be 
self-serving, or to, represent what the tester or the supervisor wants 
to hear. 



/ 



Reports on specific problems 



Very often, feedback information points to a problem but not 
to its solution. Test grades at the end of a unit are uncommonly 
low. Students are showing lack of interest in a certain topic. Many 
classroom teachers report that their^^pupils did not understand the 
main i^eas of a_ week of televised teaching. And so fdrth. These are 
clearly problems, but to know what to do about them it is neces-sary 
to gather more information and perhaps even to try out a solution or 






two. 



This is the most dotnmonly neglected aspect of ITV feedback 
systems, probably because it takes time and personnel and has to be 
done on call, rather than on a regular schedule. Yet some naOions 
think "educational firemen*! 'are so essential that in some gf its 
schools* they have institutionalized this role in the form of 

specialists who will come on call to help solve the problem when a 

/ 

number of pupils are not learning as they should^. In El” Salvador 
recently, help was sought from the^' evaluation research team when 



/ 
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second-term tests revealed a high incidence of failures in mathematics, 
Questionnaires and interviews with teachers and students showed that 
among bt her p roblems students had simply been unable to keep up with 
the pace cf the course. This finding was fed back to the program 
staff quickly enough so that, instead of introducing additional nev; 
material during the last month of the, following term the teleteacher 
used that, time for review of the year*s work. 

Not many ITV projects have either "firemen” to put out ”fivcc*’ 
that are discovered, or resident research teams to make studies on 
order (indeed, this latter cannot be done very often in El Salvador). 
The problem is,* then, who can be assigned to look into and diagnose 

u 

problems that the feedback reports turn up? The supervisor is most 
often given this task, but if he is to do it well he must have time 
available and he must be trained for this kind of problem-solving. 



R eview of programs and materials 



The most valuable feedback comes from studies or observation 
on the actual use of broadcasts and related materials in the .classroom. 
However, there is also a great deal to be gained by expert review of 
tapes and materials. 

This typically happens at the end of the year, when it has to 
be decided what programs to remake and what class and teacher, materials 
to revise. It is typically done by members of the program department. 

A great deal can bargained by adding certain other viewpoints to the 

" ' ^ v" / , 

\ 
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reviewer group. The most obvious addition is teachers and super- 
visors^ who. can speak of ..th.e. materials from their experience with 
them. Another important viewpoint is that of. experts who are 
familiar with television teaching in other countries, and can 
introduce information as to how some of the problems of the course 

have been solved elsewhere, and how some of the subject matter is 

/ 

taught on television elsewhere. It is., of course, extremely hard 
for programmers and teleteachers to look with a fresh viewpoint at 
their own work. Addition of experienced reviewers from outside the 
program group would be of great help in this respect. 

/ An ideal program of feedback for ITV 

There probably is no such thing as an "Ideal” program for 

obtaining feedback information, because information from the different: 

channels begins to overlap, and at some pbint the planners and admin- 

istrritors of an ITV project must decide how much overlap they want to 

pay for, and what combination of methods -- within their capabilities 

/ 

-- will most efficiently give them the amount of feedback they feel 
they need. Therefore, rather than ideal systems, there are adequate 
or inadequate systems, efficient, or inefficient ones. 

In estimating the adequacy of arrangements for feedback, an 
i.TV project director might well raise the following questions: 

1. In preparing instructional programs to be televised, doe:; 
'he have the guidance of previous tests of programs of the same kind 
^‘on the same type of pupils? 



j 
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2. Does he use pupils in the studio frequently enough so 
that the teleteacher can pace his teaching? 

3. Does he get test results back from the classroom frequently 

/ * t 

enough so that the television teacher can be guided by them? 

/ 

/ 

4. Does he obtain regular cotnments and evaluations, in a useful 

form, from the classroom teachers? / 

/ 

' 5. Does he really know what kind of teaching is going on, 

/ 

/ » 
around the television, in the classroom? 

6. Does he have sufficient information on attitudes of pupils 

and teacher's toward televis^^^n teaching in general, and their televised 



courses’ in particular? 



/ ' 



/ 



7. When he discovers a learning or attitude problem, does he 

: ! 

have someone to study it sufficiently to find out what to do about it? 

8, When th^^time comes to review the program in order to 
decide what changes shall be made and what programs remade for the 
viext year, is he/able to bring to that review process, not only the 
judgment of his program people, but also the ^experience of his teachers 
and supervisors, and the experience of skilled observers who have fkncvii 
ITV elsewhere,? 



Tl»e feedl^ack system in El Salvador 

/ \ ■ V 

/ .. . 

Checking what . El Salvador has so far done to provide feedback 



/ 



V' 



s ITV programmers, this is what we find: 



/ 



Pretesting programs -- not presently done in El Salvador. 

/ • , , 

^ Pupils in the studio -- there are no studio classes, but pupils 

are occasionally used on camei*a to take part in programs. 
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Immediate electronic feedback from the classroom -- there are 
no provisions for this system in El Salvador. 

Regular testing on program content -- the schools themselves 
give achievement tests at the end of each trimester; the research and 
evaluation' team gives achievement tests at the beginning and end of 

, ■ i ■ 

each school year. Classro'om test tesults^ are, therefore, available 
to the studio teacher not oftener than every three months, 

Regular comments from classroom teachers -- classroom teachcrr 

\ 

have been asked to fill out a feedback form on courses about once 
every two weeks. 

Regular observation of classrooms -- a utilization supervisor 
visits each classroom once a week, on the average;. these supervisors 
are now trying to perfect a guide for classroom observation, Some 

t 

studio teachers visit classrooms often enough to see how their progrr.r.. 
are being received and used. 

Reports on attitudes -- the research and evaluation team give^ 
attitude tests to pupils and teachers at the beginning' and the end of 
each school year. 

Studies of specific problems — the research and evaluation . 
team has investigated one such problem, but has limited time^for such 
work , • , . 

Review of programs and materials -- this is undertaken by the 
program, staff at the end of the school year; an average of one'-third 

' f 

to one-half or programs are being remade from last year. 
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Some suggestions 

It: is evident that El Salvadoi^ already has a number of feed- 
back ' channels -- in fact, more' than most ITV projects because of its 
strong utilization program and the presence, of a research and evalu- 
ation team. We venture the folloving suggestions: 



(1) Because of the number of feedback channels, already 
available in the El Salvador project, it would seem desirable to make 
sure that these channels are vjorking as efficiently as possible before 
adding new ones. For example, there might be an effort to perfect the 
teachers' feedback form to make it as practically useful as possible. 

The present effort of the utilization group to perfect their classrocr.i 
observation guide is obviously of importance. Different ways, of usingj 
students to' furnish incidental feedback as participants in programs \ 
might well be tried. And studio, teachers might well.be encouraged to 1 
visit classrooms as often as possible. ‘ 

“(2) The easiest and probably most practically useful addition * ^ 

1 

I, 

to the present feedback program would be a five-minute test in each \ 

televised course each week, so that it could be known whether^ at least 
the essentials of the bourse are being understood and learned — in 
time to do something about it. Needless to say, this kind of feedback 
would be more useful, during 1970, in the eighth grade, whete programs 
are being made new, than in the seventh, where programs 'will already 
have been revised and taped on the basis of the previous year's 
ey^erjiince, — ' 



O 
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(3) When it becomes possible, El Salvador should consider 
pretesting prototype programs for each new series. 



\ 

[Reference to research reports in this memorandum are to titles which 
are listed and described in Chu and Schramm, Learning from Televis ion' 
What the Research Says . Washington: NAEB, 1967.] 
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